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ABSTRACT 

The paper aims to design cross-layer optimal scheduling al- 
gorithms for cooperative multi-hop Cognitive Radio Net- 
works (CRNs), where secondary users (SUs) assist primary 
user (PU)'s multi-hop transmissions and in return gain au- 
thorization to access a share of the spectrum. We build 
two models for two different types of PUs, corresponding to 
elastic and inelastic service classes. For CRNs with elastic 
service, the PU maximizes its throughput while assigning a 
time-share of the channel to SUs proportional to SUs' assis- 
tance. For the inelastic case, the PU is guaranteed a mini- 
mum utility. The proposed algorithm for elastic PU model 
can achieve arbitrarily close to the optimal PU throughput, 
while the proposed algorithm for inelastic PU model can 
achieve arbitrarily close to the optimal SU utility. Both al- 
gorithms provide deterministic upper-bounds for PU queue 
backlogs. In addition, we show a tradeoff between through- 
put/utility and PU's average end-to-end delay upper-bounds 
for both algorithms. Furthermore, the algorithms work in 
both backlogged as well as arbitrary arrival rate systems. 

Keywords 

Congestion control, network scheduling, multi-hop wireless 
networks, cognitive radio networks, end-to-end delay guar- 
antees 



1. INTRODUCTION 

In traditional networks, spectrum bands or channels are 
allocated to licensed users. However, such fixed spectrum 
assignment gives rise to the spectrum under-utilization prob- 
lem as was reported by Federal Communication Commission 
(FCC) 1.:. Cognitive Radio Networks (CRNs) [S] have re- 
cently emerged as a technology for unlicensed users, referred 
to as secondary users (SUs), to opportunistically utilize the 
spectrum assigned to licensed users, referred to as primary 
users (PUs). Researchers have been working on optimizing 
data rate and throughput of CRNs in single-hop settings 
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El- El- However, these works are not readily extendable to 
multi-hop CRNs, since multi-hop transmission requires that 
the CR policies take into account scheduling and routing 
issues. 

Back-pressure scheduling algorithms with Lyapunov opti- 
mization tools have been extensively investigated for generic 
wireless networks [11][12]. In addition to the seminal work 
[If| . distributed and low- complexity algorithms have been 
proposed in the literature such as [14j[15j. This technique 
has been applied to CRNs in [Zl-[l0]. Specifically, in [3, an 
optimal cross-layer scheduling algorithm have been proposed 
in a single-hop setting to maximize SU throughput subject 
to PU collision constraints. This single-hop setting is ex- 
tended in [8] where aggregated utility is maximized subject 
to PU power constraints. In [9j, a cooperative CRN is con- 
sidered to optimize PU and SU utility, where SUs assist PU 
transmission in a two-hop relay scenario, which is not readily 
extendable to generic multi-hop CRNs. A multi-hop CRN 
scheduling algorithm is proposed in [TO], without consider- 
ing cooperation between PUs and SUs. To the best of our 
knowledge, no throughput/utility-optimal scheduling algo- 
rithms have been proposed in the literature for cooperative 
multi-hop CRNs. 

In this paper, we propose two optimal cross-layer schedul- 
ing algorithms for a multi-hop cooperative CRN, where SUs 
relay data for a PU pair to gain access to the licensed spec- 
trum. These two algorithms aim to solve the throughput/utility 
maximization problem under the so-called inelastic and elas- 
tic PU models. In the inelastic PU model, the PU pair is 
guaranteed a minimum utility and the SU utility is maxi- 
mized. In this model, we consider an adaptive-routing sce- 
nario where the routes of the PU flow are not determined a 
priori, which is more general than a fixed-routing scenario. 
In the elastic PU model, the PU throughput is maximized 
using fixed routes while the SUs are guaranteed a through- 
put proportional to the PU data that they relay. 

Salient contributions of our work with respect to the liter- 
ature can be listed as follows: (I) Both inelastic and elastic 
algorithms can achieve a throughput/utility arbitrarily close 
to the optimal values. (2) The algorithms guarantee deter- 
ministically upper-bounded finite buffer sizes for PU queues 
in the CRN. (3) We identify a tradeoff between the through- 
put/utility and the average end-to-end delay upper-bounds 
for PU data: the inelastic algorithm achieves a PU delay 
upper-bound of order 0(-^), i.e., polynomial delay [27] is 
achieved, where TV denotes the number of nodes involved 
in PU relay and e characterizes the difference between the 
achieved utility and the optimal utility; The elastic algo- 



rithm achieves order optimal delay [21] [22], i.e., the delay 
is upper-bounded by the first order of the number of hops 
in a route. (4) Both algorithms are extended from a back- 
logged source model to a model with arbitrary arrival rates 
at transport layer. 

The rest of the paper is organized as follows: Section 2 
introduces the network and PU models for the cooperative 
multi-hop CRN. In Section 3, we propose and analyze the 
inelastic algorithm. The elastic algorithm and its perfor- 
mances are provided in Section 4. In Section 5, we extend 
both algorithms to the model with arbitrary arrival rates at 
transport layer. We conclude our work in Section 6. 



2. NETWORK MODEL 

In this section, we first present the overall multi-hop co- 
operative CRN model, followed by analysis of the two PU 
models. 

2. 1 Overall Network Elements and Constraints 

In this paper, we consider a multi-hop cooperative CRN 
where SUs relay PU data in return for the right to use the 
wireless spectrum. The multi-hop cooperative CRN in ques- 
tion can be divided into two subnetworks: a "PU relay sub- 
network" and an "SU subnetwork". The PU relay subnet- 
work is composed of one primary source node (sp), a corre- 
sponding primary destination node {dp), and a set of SUs S 
that relay the PU traffic between sp and dp over possibly 
multiple hops, where | <S |= A*'. We assume that the chan- 
nel condition cannot support direct transmission between 
the PU pair, and thus PU data will be solely relayed by 
secondary nodes. Denote the node set of the PU relay sub- 
network by TV = {sp,dp} U S. Denoting the set of links 
in PU relay subnetwork as C, we can represent the PU re- 
lay subnetwork as [M, C). Note that our model is readily 
extendable to the scenario of multiple PU pairs. 

The SU subnetwork is composed of the set of SUs S that 
participate in PU data relaying, and the set of their one-hop 
secondary neighbors 5' with which they communicate. For 
notational simplicity, we assume that <S fl 5' = and that 
there is a distinct SU I' £ S' that corresponds to every SU 
I G S. Then, the SU subnetwork is represented by [S U 
5', £'), where £' = {{I, I'): l€S, I' e S'} is the set of links 
in the SU subnetwork. Note that our analysis can readily 
be extended to cases where <S n 5' 7^ 0. 

Let V = £ U Then the CRN topology is represented 
by an interference graph G — (V, £) (or sometimes referred 
to as conflict graph). There is an edge in £ between two 
links in V if the links interfere with each other when sched- 
uled simultaneously. Furthermore, let fimn be the scheduled 
link rate for PU data over link (m, n) £ C, and denote the 
scheduled SU link rate as si over link {1,1') £ £'. For an- 
alytical simplicity, we assume a scheduled link rate takes a 
value from {0, 1}. A link schedule represented by a vector 
{{lJ'mn)(m.n)£C, {si)ies) G {0, is Said to be feasible 

iff any pair of two scheduled links does not belong to the 
interference edge set £. Let I be the set of feasible link 
schedules. Then, a feasible link scheduler chooses a feasi- 
ble link schedule {{fJ.mn{t))(m.,n)ec, {si{'t))ies) G I for each 
time slot t. In addition, we assume that each node only 
possesses one transceiver that can only send or receive data 
from one neighbor node. Thus, Vn G Af\{sp}, the following 



inequality holds: 

^ f^jn{t)+ ^ flni{t) + l {t) < 1, yt, (1) 

where l^^,} is the indicator function for event x. Note that 
since sp is the sender of the PU pair, we must have 

In the following two subsections, we build two PU mod- 
els corresponding to different PU service classes, namely, 
inelastic PU model and elastic PU model. In the inelastic 
PU model, adaptive-routing scenarios are considered and 
we maximize SU utility while PU is guaranteed a minimum 
utility. In the elastic model, we assume fixed-routing sce- 
narios and maximize the PU throughput while SUs obtain 
a throughput proportional to the PU data that they relay. 

2.2 Queueing Structure and Constraints for 
Inelastic PU Model 

In the inelastic PU model, we denote by U„{t) the queue 
backlog for PU packets at node n £ M, where Udp {t) = "it. 
Let Qi {t) be the queue backlog for SU packets corresponding 
to the SU pair associated with I £ S. Now we define the 
stability of a generic queue with queue backlog X{t): X{t) 
is said to be stable if 

1 

lim sup — V E{X{t)} < oo. 

Therefore, the network is stable if queues Un{t) and Qi{t) 
are stable Vn £ M and VZ £ S. 

For the time being, we assume that PU and SU traffics 
are backlogged at the transport layer. Thus, a congestion 
controller is needed to admit packets into the network layer. 
Let /ipsp {t) be the admitted PU arrival rate in time slot t. 
Note that we can consider p in the subscript of /ipsp {t) as 
the virtual node representing the PU transport layer and 
consider (p, sp) as the virtual link from transport layer to 
source PU, so we construct a new link set as £'^ = £ U 
{{p, Sp)}. Let Ai{t), I £ S,he the admitted SU arrival rates 
to the SU pair associated with secondary node I in time 
slot t. We assume fj,psp{t) < ^j,m and Ai{t) < Am VZ G <S, 
where hm and Am are the upper-bounds for admitted PU 
and SU arrival rates, respectively. For analytical simplicity, 
we assume that admitted packets are added to the queues 
at the end of time slot t. 

From the above analysis, we can develop the queueing 
dynamics for Un{t), n G N\{dp}, as follows: 

Ur,{t+l)<[Ur,{t)- Mn»(t)]++ ^ /ij„(t), (2) 

j:{?i,i)6£ j:(j,n)SC'' 

where [a;]^ = max{a;,0} and '}2i-(„ i)£c stands for the 

scheduled service rate. Note that ([2]) is an inequality since a 
feasible scheduler can be designed independent of the queue 
backlog information. Specifically, the inequality holds when 
the actual arrival rate at node n is less than the scheduled ar- 
rival rate "^j.fj „)izc^ l-i-jn{t), i.e., some neighbor node j does 
not have packets for the scheduled transmission fijn{t) = 1. 
Similarly, Qi{t), I £ S , evolves as follows: 

Qi{t + 1) = [Qi{t) - si{t)]+ + Ai{t). (3) 



We denote by f{x) and gi{x) with I £ S, respectively, the 
PU and SU utility functions of the time-average transmission 
rate. As convention, we assume that the utility functions 
are positive-valued, concave, strictly increasing and contin- 
uously differentiable, with /(O) = and (?i(0) = G 5. 
Examples of utility functions include 9'log{l + x) and 9'x, 
where ^' > is a weight for the utility functions. We as- 
sume the inelastic PU imposes a minimum utility constraint 
ap, i.e., the utility of the time-average PU transmission rate 
must be greater than or equal to ap. 

According to [11] [12], we define the capacity region A/ 
of the inelastic CRN as the closure of all feasible arrival 
rate vectors consisting of an admitted PU arrival rate and 
A'^ admitted SU arrival rates, where each feasible arrival 
rate vector is stabilizable by some scheduler. Without loss 
of generality, we assume that there exists an SU rate vec- 
tor (r-;);g5 such that (/~^(ap), {ri)i^s) is strictly inside A/, 
where f~^{x) is the inverse function of the utility function 
f{x). To assist the analysis, we let {r* ^)i^s be a solution to 
the following optimization problem: 

max y^giiri), 

where e > can be chosen arbitrarily small. Then according 
to [13], we have: 

^^°+fts Its 
where {ri)i^s is a solution to the following optimization: 

max y^aiiri). 

In Section 3, we will propose an algorithm that satisfies 
the PU minimum utility constraint and can achieve SU util- 
ity arbitrarily close to the optimal value X^igsSK'";*)! with 
a tradeoff between the SU utility and the average PU delay 
upper-bound. 

2.3 Routing and Queueing Structure for Elas- 
tic PU Model 

For the elastic PU model, we consider a fixed multi-path 
routing scenario, where the PU data transmission have K 
loopless pre-determined routes. We denote the path for the 
fc-th route as Pk = {Vk,vl, ...,vjf'' ,vj^'''^^), where (Ht + 1) 
is the total number of hops in the PU relay subnetwork 
for route fe, where e Af, "im e {0, 1, ...,Hk + 1}, Vfc G 
{1,2,..., K}. Without loss of generality, we assume that each 
node Z G iS is in at least one of the K routes, that is: VZ G iS, 
3k, m s.t. = I. Note that we always have = sp and 
vjf''^^ = dp, Vfc G {1,2, K}. According to this routing 
structure, we construct PU queues 17^ (t) along the nodes 
in the K routes, where < m < Hk + 1 and 1 < k < K . 
Note that, since v^'''^^ = dp, we have U^^^i{t) = 0, Vt, 

vfcG {1,2,...,;^}. 

Similar to the inelastic model, we assume that PU and SU 
traffics are backlogged at the transport layer. Let /x* i o(i) 
be the admitted arrival rate from the PU transport layer 
to the source PU that is scheduled to pass through the k- 
th route. Note that, consistent with the elastic model, we 
assume that the sum of admitted PU arrival rates over K 



routes is upper-bounded by hm, i.e, 

K 

X]A'-i,o(i) < MAI", yt. 

k=l 

In addition, we let Xk, k = {1, 2, ...K}, be the time-average 
of ii'Li Q{t). Let Hm,m+i{i), < m < Hk, be the sched- 
uled rate for the hop (w™, t'™^^) along the fc-th path. Thus, 
Um{t) evolves as follows: 

U!^{t+1) < [(7^(t)-Mm,m+l(t)] + +Atm-l,mW, < m < Hk, 

(4) 

where the inequality holds if A'm-i,m(^) = 1 a-nd U^_i{t) = 
0, 1 < m < Hk- Note that a link {m,n) G £, can be a hop 
in multiple routes, and hence we can only schedule the hop 
with rate 1 on one such route in any time slot. 

Let pk be the reward for SUs when a packet is admitted 
to route fc, i.e., pkfJ--ifi{t) packets will be admitted simul- 
taneously to the SU queues corresponding to the nodes Vk', 
1 < m < Hk- Here, we assume that Pfe/i'li,o(i) takes inte- 
ger values. Note that our analysis is readily extendable to 
fractional- valued PfeM'li,o(*) by constructing a counter that 
only admits LpfeM-i,o(*)J packets, where [x] is the floor func- 
tion. Also note that the analysis can be extended to delayed 
rewards, i.e., a reward rate PkfJ--ifi{i) is admitted to SU 
queues ai t + r', where r' is the delay in unit of time slots. 

From the above analysis, the SU queueing dynamics for 
Qi{t) can be expressed as follows: 

Qi{t+1) 

fc = l m-l (Oj 
K 

^[Ql{t) - S;(t)]+ + ^PfcM-l,o(i)l{3m: «™=0. 
fc=l 

where the second equality holds since each route is a loop- 
free. 

The network is stable if queues [t) and Qi (t) are stable 
Vm, k VZ. Then, we define the capacity region A_b of the 
elastic CRN as the closure of all feasible arrival rate vectors 
each stabilizable by some scheduler. Note that a feasible 
arrival rate vector is in the form of 

K 

{{^k)ke{l,2,...,K}, P*'^fcl{3"i: u^=o)'G'S) 
fc=i 

where {Xk)ke{i,2,...,K} represents the PU arrival rates per 
route and {Y,k=i Pfc-^fcl{3m: u™=o)!es represents the SU ar- 
rival rates according to the reward mechanism. To assist the 
analysis, we let {XX^^)ke{i,2,...,K} be a solution to the follow- 
ing optimization problem: 

K 

max Xk 

{^fc)fce{i,2 K} j.^-^ 

K 

s.t. (Xk) ■- {{Xk + e), {J2 + ^)1{3™: vj^^i})) e Ab 

k = l 

where e > can be chosen arbitrarily small. Similarly, ac- 
cording to [13] . we have: 

K K 

lim >^ X*k . = >^ At , 



where {^t)ke{i.2,...K} is a solution to the following optimiza- 
tion: 

K 

max Afe 

(Afc)fce{i,2,...,K} j.^^ 

K 

S.t. (Afc) ; {{\k),(^PkXkl{3m: «^=!})) £ ^-B 

In Section 4, we will propose an algorithm that can achieve 
a PU throughput arbitrarily close to the optimal value X^j^i -^fci 
with a tradeoff between the PU throughput and average 
PU/SU delay upper-bound. 

3. INELASTIC ALGORITHM FOR THE CRN 

In this section, we first introduce two types of virtual 
queues and their structures to assist the development of the 
inelastic algorithm. The inelastic algorithm is then intro- 
duced in Subsection 3.2. 

3.1 Virtual Queues and Approaches 

We construct a virtual queue Up{t) at the PU transport 
layer with the following queue dynamics: 



Up{t + 1) = [C/p(t) - /xp«^ + R{t), 



(6) 



where R{t) denotes the virtual arrival rate to Up{t) in time 
slot t which will be determined by the inelastic algorithm 
in the next subsection. Furthermore, let R{t) be upper- 
bounded by fiM- When Up{t) is stable, we know from queue- 
ing theory that the time-average admitted PU arrival rate 
fi satisfies: 



lim 



(7) 



The virtual queue Up{t), along with R{t), regulates the ad- 
mitted PU arrival rate in the inelastic algorithm, in an at- 
tempt to guarantee an average end-to-end delay upper-bound, 
as will be stated in detail in the next subsection. 

We construct another virtual service queue Z{t) at the PU 
source node sp with the following queueing dynamics: 



Z{t +1) = [Z{t) - R{t)]+ + r\ap). 



(8) 



When Z{t) and Up{t) are stable, we have /(^) > /(r) > ap. 
Specifically, the minimum utility constraint imposed by PU 
is satisfied when the two virtual queues are stable. 

3.2 Inelastic Algorithm 

We design a control parameter qm indicating the buffer 
size for each PU queue in the CRN, with qm > Mm. The op- 
timal inelastic algorithm consists of four parts, namely, SU 
congestion controller, R{t) controller, PU congestion con- 
troller and a link scheduler, described as follows. 

1) SU Congestion Controller: 

VMMt)),\iies, (9) 



min Ai{t)Qi{t) 

0<Aiit)<AM 



where Vi > is a control parameter in the algorithm. Note 
that we always have Ai{t)Qi{t) — Vigi{Ai{t)) < under the 
SU congestion controller, since Ai {£) = is a valid candidate 
for the admitted arrival rate. 
2) R{t) Regulator: 



min R(t)(Up(t) 

0<R{t)<p.M 



QM — I^M 



Z{t)). 



(10) 



Specifically, when Up{t) '^"~^'^" - Z{t) > 0, the virtual rate 
R{t) is set to zero; otherwise, R{t) = hm- 

3) PU Congestion Controller: 

max fipBp{t){qM — fJ.M ~ Usp{t)). (11) 

0<Hpsp (t)<MAf 

Specifically, when qm — fiM — Usp{t) < 0, the admitted PU 
arrival rate fipsp{t) is set to zero; Otherwise, fJ.pap{t) = i^m- 

4) Link Rate Scheduler: 

max y Hmn{t)^^^{Um{t)-Unit)) + y"Ql{t)si{t), 

— ' QM — ' 

{m,n)e£ ^ les 

(12) 

with the constraint {(Mmn(t))(m,n)e£, isi(t))i^s} £ 1. Note 
that when Um{t) — Un{t) < 0, (m, n) £ £, we set /imn(t) = 
according to H12|) . 

The inelastic algorithm has the following property: 



Proposition 1. 



(13) 



Proof. We can prove Proposition 1 by induction. Ini- 
tially when t — 0, Uri{0) = Vn £ A/". Now assume in time 
slot t we have Un{t) < qm Vn £ N . In the induction step, 
we consider two cases: 

Case 1: n = sp. If Usp{t) < qm — f^M, then since the ad- 
mitted arrival rate to Uap (t) is bounded by hm , we have 
Usp(t + 1) < Usp{t) + /iA/ < qM- Otherwise, we have 
Usp(t) > qM — /iA/, and according to the PU congestion 
controller Hll|) we have /ipsp (t) — 0, from which we obtain 
U,p{t + 1) < U,p{t) < qM- 

Case 2: n sp. If C/„(f) < gAf — 1, then we have Un{t + 1) < 
Un{t) + 1 < qM according to U]) and the queueing dynamics 
((2]). Otherwise, we have Unit) ~ qM and f/„(t) > Um{t) 
Vm G A/", and according to the link scheduler ((T5} we have 
f^jn{t) = Vj such that {j,n) £ £, from which we obtain 
Un{t + 1) < Unit) = qM by the queueing dynamics ((2]). 

Therefore, U„{t -|- 1) < qM Vn G A/", i.e., the induction 
step holds, and the proposition is proved. ■ 

Now we present the main results of the inelastic algorithm 
in Theorem 1. 

Theorem 1. Lete > be chosen arbitrarily small. Given 
that 



qM > 



+ 1-I.M, 



(14) 



the inelastic algorithm ensures the following inequality on 
queue backlogs: 

T — l 

lim sup i J2 + Ur>it) + Z{t)} < 

(15) 



A 1 ,,2 I Iff-l/,, \\2 I I^MilM-i^M) I 1 



where Bi ^ + l(/-i(/^„))2 + 



^NA\j -f \iiMqM{N + 1), Si is chosen such that < 5i < 



2qM ' 



and gM is defined as: 



gM ^ lim sup i - E 

<Y.^9i{AM)^gi{rU)). 



Furthermore, the inelastic algorithm achieves: 



(16) 



where ai is defined as the time-average ensemble value of 
Mt): 



ai 



1 



Remark 1 (Network Stability): The inequalities (|13p from 
Proposition 1 and (|15p from Theorem 1 indicate that the in- 
elastic algorithm stabilizes the actual and virtual queues. As 
an immediate result, the network is stable and the minimum 
utility constraint is met. In addition, Proposition 1 ensures 
that the actual PU queues are determmistically bounded by 
the finite buffer size qm- 

Remark 2 (Optimal Utility and Tradeoff with Delay): The 
inequality (|16[l gives the lower-bound of the SU utility the 
inelastic algorithm can achieve. Since the constant Bi is 
independent of the control parameter Vi , the algorithm can 
achieve a utility arbitrarily close to the optimal value 
X^igsSK*";*) s-s £ is chosen arbitrarily small, with a tradeoff 
in the PU buffer size qm which is of order 0{^) as shown 
in (|14p . By Little's Theorem, the average end-to-end delay 
upper-bound is of order 0{^). Note that it is easy to verify 
that when apphed to a fixed-routing scenario, the inelastic 
algorithm achieves an average end-to-end delay upper-bound 
of order 0(-^), where H denotes the number of hops in the 
route. 

Remark 3 (Complexity of Algorithm): In the inelastic al- 
gorithm, the SU congestion controller, the R{t) regulator 
and the PU congestion controller can operate locally at SU 
transport layer and source PU. The link rate scheduler is 
essentially a centralized maximal weight matching problem 
[11] [16]. To reduce complexity of the link rate scheduler, 
suboptimal algorithms can be developed to at least achieve 
a fraction 7 of the optimal utility. These suboptimal al- 
gorithms include the well-studied Greedy Maximal Match- 
ing (GMM) [IS] algorithm with 7 = | and the majcimum 
weighted independent set (MWIS) problem such as GW- 
MAX and GWMIN proposed in [^ with 7 = 
is the maximum degree of the CRN topology. 

Remark 4 (Distributed Implementation of the Link Sched- 
uler): Distributed implementation can be developed in much 
the same way as in [Tl] to achieve a fraction of the optimal 
utility. In order to achieve a utility arbitrarily close to the 
optimal value with distributed implementation, we can em- 
ploy random access techniques [24] [25] in the link scheduler 



■i, where A 



with fugacities 26 chosen as exp{ 



aUp(t)lUrr,it)-U„(t)]^ 



} for 



link (m,n) £ L and &qi{oiQi(t')\ for an SU link associated 
with I € <S, where f7p(t) is a local estimate of U-pit) and a 
is a positive weight. It can be shown that the distributed 
algorithm can still achieve an average PU end-to-end delay 
of order O(^) with the time-scale separation assumption 
[22]- [24]. Due to limited space, a detailed discussion is omit- 
ted. 

We prove Theorem 1 in the next subsection. 

3.3 Proof of Theorem 1 

Before we proceed, we present Lemma 1 as follows to assist 
us in proving Theorem 1. 



Lemma 1. For any feasible rate vector (6, {ri)i(=s) £ A/, 
there exists a stationary randomized algorithm SI that stabi- 
lizes the network with SU admitted arrival rate Af'(t) = ri, 
Vt VZ € S, and PU admitted arrival rate fip'^{t) = 0, Vi, 
and schedule {{iJ-mn{i)){m,n)eCi {^f {i))ies} independent of 
queue backlogs satisfying: 



E{sf'{t)}^ri, Mt, yi€S. 

Note that it is not necessary for the randomized algorithm 
SI to provide finite buffer size or delay guarantees. Similar 
formulations of stationary randomized algorithms and exis- 
tence proofs have been presented in [8] [11)-[T3]. so we omit 
the proof of Lemma 1 for brevity. 

Remark 5: According to the SI algorithm in Lemma 1, 
we assign the virtual input rate as R^\t) = fip'^{t) = 6, \/t. 
Hence, the time average of R^'{t) satisfies r'^' = 6. Note 
that {e,{ri)i^s) can take values as (/"^(a) -I- |e, (r;* Jjgs) 

or + ('■;% + <;)ies)- 

We define the queue vector Q/(t) as: 

Qj(t) = (([/„)„e^, iQi)ies, Up(t), Z[t)) 

and define the Lyapunov function Li((^j(t)) as follows: 



QM 



2 , Un{tfUp{t) 



+ z{tf + j2 



qM 



where the last term of the above Lyapunov function takes 
a similar form as in [IZl[IH]- Then, the corresponding Lya- 
punov drift is defined by 

Ai(t) ^ E{Li(Qj(t + 1)) - Li{Qj(t))\Qj{t)}. 

By squaring both sides of the queueing dynamics ([2]) ([3]) ([6]) ([HJ 
and through algebra, we can obtain: 

A,{t)-V,J2^{gi{AmQ,(t)} 



+ iV + 1 
2qM 



^ — ' qu ^ — ' 



- E M."(t))|Q,(t)} 

j:(j,n)G£<= (17) 

-E{Z{t){Rit)^f-\ap))\Q,{t)} 
qM 

■E{^Qi{t){si{t)-A,mQjit)} 
les 

■ViJ2E{gi{AimQ,{t)}, 

l£S 



where we also employ the following inequalities: 
U„(t + lfUj,{t+l) 



to 



E 



<flMqM{N + 1) + ^(mm + iV + 1) + ^ V U^itf 

OAT — — — 

^ nSAf i:{n,i)e£ j:(j,n)€C^ 

Through algebra, we find the equivalence of (fTT)) : 

les 

+ Y,HMt)Qi{t) - Vigi{,Mt))\cij{t)} 

i&s 

+E{i?(i)(i2^ii^i^^^il^ _ zit)mm (18) 

-E{fIpsp{t)'^^{qM-flM - t/p.pW)|Q/(t)} 

qM 



-E{J2Qi{t)siit) 



+ V MmnW-^([/„.W-[/nW)|Q,(t)}. 



Note that the last four terms of the RHS of psp are mini- 
mized by the SU congestion controller (|9]), the regulator 
P0[) . the PU congestion controller pip , and the link sched- 
uler H12p . respectively, over a set of feasible algorithms in- 
cluding the stationary randomized algorithm SI introduced 
in Lemma 1 and Remark 5. Then, we substitute into the 
fourth and fifth terms of the RHS of (fTS)) (i.e., the third 
and fourth lines of psp ) a stationary randomized SI with 
admitted arrival rate vector (/~^ (a) + {'''i^e)i&s) , and we 
substitute into the last two terms the SI with admitted ar- 
rival rate vector (/~^(a) -|- e, (ri*e -|- e)ie5). After the above 
substitutions, we obtain: 

Aj{t) ~ViJ2^{m{Mt))\Q,{t)} 



2qM 



les les 



(19) 



where the second inequality holds when the condition (|14p 
in Theorem 1 is satisfied. 

We take the expectation of both sides of (|19p over Clj{t) 
and take the time average on f = 0, 1, T — 1, which leads 



<5i 



^^E{^Q,(t) + C/p(t) + Z(i)} 



T-l 



(20) 



T 



By taking limsup of T on both sides of (|20p . we can prove 
(|15p. We can prove (|16p by taking the liminf of T on both 
sides of (I20p and by employing the following fact from the 
concavity of the SU utility functions: 

Therefore, Theorem 1 is proved. 

4. ELASTIC ALGORITHM FOR THE CRN 

In this section, we design the optimal elastic algorithm 
composed of two parts, namely, PU congestion controller 
and a hop/link scheduler, described in Subsection 4.1. Note 
that according to the fixed-routing structure in PU relay 
subnetwork introduced in Subsection 2.1, when developing 
the scheduler, we focus on the hop/link schedule 
{{fJ-m,ni+i{'t))m.k, {si{t))ies)) wMch is composed of a PU hop 
schedule and an SU link schedule. Note that each hop 
schedule (/im,m+i (i))m,fe corresponds to a PU link schedule 

(m,ri) £ C • 

4.1 Elastic Algorithm 

1) PU Congestion Controller: 

K 

min^/i^ii^o(*)(/5fcE'5i(*)l{3m: «'r=0 
k=i les 

+ US{t)-V2) (21) 

K 

s.t. '^^I'Llfi{t) < ^IM, 

where V2 is a control parameter in the algorithm. For time 
slot t, define k* = argminfe(pfe Jlligs Qi(*)l{3m: 1.^=0 + 
Uo{t)). Specifically, from ^T^, we set 

{^M, if Pfc* ^ Q;(t)l{3m: =0 + Uq {t) < V2, 
0, otherwise. 

For k / fc*, we set p^i_o(t) = 0. 

2) Hop/Link Scheduler: 

K Hfc 

™^^{E E 

fe = l m = 

+E^'W^'W}' ^^^^ 

les 

s.t. {(Mmn(i)){m,n)e£, (Si(*))!e5} ^ ^ 

where the optimization is taken over all feasible 
((Mm,m-n (i))m,fe,(s!(t));es)) and we note that each hop sched- 
ule {fJ-m^rn+i{i))m,k correspouds to a PU link schedule 
(Mmn(t)){m,n)e£- From IHJ, when Ul^{t) - Ut+i{t) < 0, 
m € {0, 1, ...,IIk}, we set nt„m+i{t) = 0. 

The elastic algorithm has the following property: 



Proposition 2. Vm G {0,1, Hk}, Vfc e {1, 2, if}, 
i/ie following inequality holds: 

Ut{t)<UM^tiM+V2. (23) 

Proof. Similar to the proof of Proposition 1, we prove 
Proposition 2 by induction. Initially when t = 0, (0) — 
Vm, Vfe. Now assume in time slot t we have U^{t) < Um, 
Vm, Vfc. In the induction step, we consider two cases: 
Case 1: m = 0. Given any route k, if Uo{t) < V2, then we 
have Uo{t + 1) < C/q (t) + hm < Um according to queueing 
dynamics ([3}, where we recall that /^!li,o(i) 5: Ma/ from the 
constraint in PU congestion controller (|2ip . Otherwise, we 
have V2 < U(){t) < Um, and hence we have 

which induces fi'Li Q{t) = from the PU congestion con- 
troller ((21}, and it follows that Uo{t + 1) < Uo{t) < Um by 
the queueing dynamics Q. 

Case 2: m € {1, 2, Hk}, for any given route k. If U^{t) < 
Um - 1, then we have Ut{t + 1) < f7m(i) + 1 < ?7m accord- 
ing to queueing dynamics @. Otherwise, we have U^{t) = 
Um > C/m_i(t), and according to the hop/link scheduler 
we have iJ-m-i,m{i) ~ 0, from which we have 17^ (t + 1) < 
Um{i) ~ Um by the queueing dynamics Q. 

Therefore, Ut{t 1) < Vm G {0,1,...,//^}, Vfc G 
{1, 2, ii'}, i.e., the induction step holds, and the proposi- 
tion is proved. ■ 

As a complement to Proposition 2, recall that given route 
k, we always have Uij^^i(t) — 0, Vt. 

Now we present the main results of the elastic algorithm 
in Theorem 2. 

Theorem 2. Let e > be chosen arbitrarily small. The 
elastic algorithm ensures the following inequality on queue 
backlogs: 

li- -P ^ E E{E (^)} < ^^^^ , (24) 

where B2 = \K{N + 2) + \N + ^Nfili ma^k pi, S2 = 
e miufc pk , and Br is defined as: 




K 

< PM — E '^fc.e- 

Furthermore, the inelastic algorithm achieves: 

^ip^S.^ f E EEiA'-i.o(i)} > E ^^.^ - (25) 

Remark 6 (Stability): The inequalities (|23p from Propo- 
sition 2 and ((24} from Theorem 2 indicate that PU and SU 
queues are all stable, and hence is the CRN. In addition, 
Proposition 2 ensures that PU queues maintained in each 
route are deterministically bounded by the finite buffer size 
Um. 

Remark 7 (Optimal Throughput and Tradeoff with Delay): 
The inequality (|25[) gives the lower-bound of the throughput 
the elastic algorithm can achieve. Since the constant B2 is 



independent of the control parameter V2, the algorithm can 
achieve a PU throughput arbitrarily close to the optimal 
value X^s^i -^fc ^ ^ '^''■n be chosen arbitrarily small and V2 
can be chosen arbitrarily large, with the following tradeoffs 
in PU and SU delay; 

• The PU buffer size Um is of order 0(V2) as shown in 
(|23|l . By Little's Theorem, the PU's average end-to- 
end delay over any given route k is of order 0{{Hk + 
1)V2) which is bounded by the first order of Hk, i.e., 
the algorithm has order-optimal delay per route. 

• From (|24[) . the average SU buffer occupancy is of order 
O(-^^-i^). And so is the SU average delay by Little's 
Theorem. The average SU delay upper-bound has an 
extra term i in order compared with the average PU 
delay. 

Remark 8 (Employing Delayed Queue Information): The 
PU congestion controller (|21|) is performed at the source PU. 
Thus, in order to account for the propagation delay of queue 
information (Q;(t));g5, we can replace {Qi{t)) in ((2T|) by 
{Qi{t — t)), where r is an integer number that is larger than 
the maximum propagation delay from any node to a source. 
It is not difficult to show that Theorem 2 still holds with 
a different value of B2, with similar proof techniques as in 

Wc prove Theorem 2 in the next subsection. 

4.2 Proof of Theorem! 

Before we proceed, we present Lemma 2 as follows to assist 
us in proving Theorem 2. 

Lemma 2. For any feasible rate vector 

K 

{{^k)keL{l,2,---,K},C^Pk^kl{3m: i.™=o)'6s) G Afi, 

there exists a stationary randomized algorithm SE that stabi- 
lizes the network with PU admitted arrival rates p'^^i^it) = 
\k, yt Vfc G {1, 2, K} and a hop/link schedule 
iipm,m+ii't))m,k,(sf^{t))i^s) independent of queue backlogs 
satisfying: 

E{M^;!t-(i)-M::;^^+iW} = 0, Vt, Vm,fc; 

K 

E{sr(t)} = E'°'=^'=^{3'"- -^=0' 
fc=i 

Similar to Lemma 1, it is not necessary for the randomized 
algorithm SE to provide finite buffer size or delay guaran- 
tees. For brevity, we omit the proof of Lemma 2, and inter- 
ested readers are referred to [8] [Il]-[l3] for details. Note that 
(Afc)fcg{i,2,...,K} can take values as (A^^Jk and (A^ + e)k. 

We denote the queue vector Q^i^) = {{Um)m,k, {Qt)i£s) 
and define the Lyapunov function i£;(Q£;(i)) as follows: 

LEiQAt)) = i{E E w)' + E w'} 

Then, the corresponding Lyapunov drift is defined as 
AE{t) ^ E{LB(Qs(t + 1)) - LB(Qs(t))|Qs(f)}. 



By squaring both sides of the queueing dynamics ©([S]), 
we can obtain: 



m,m+ 1 



k-1 m=0 



f-^m— l,m 
1 2 ^ fc 

+ 2 E'^'t'*'(*)^ + {^Pk^i-l,o{'t)'i-{^m■. v^=i}f 

K 

-2Q,(t)(s,(t)-^Pfc/i*ii,oWl{3m: „™=o)IQeW} 
fc=i 

if 

-y2E{^/i'ii,o(i)IQBW}, 
fc=i 

from which we obtain: 

K 

Ai,-l/2E{^M-i,oWIQBW} 

fc=i 

<B2-V'2E{^M-i.o(i)IQi;W} 

K 

fc = l m=0 

-^E{Q,(t)(sKt) 

lec 

K 

fe=l 

Through algebra, we find the equivalence of ((26}: 

K 

Ab-F2E{^/_i,oW|Q^W} 

fc=l 

if 

<B2+E{^M-i,o(i)x 
fc=i 

(PfcE'3'Wl{3'"^ .r='}+t^o'(i)-^^2)|Q£;W} (27) 

if fffc 

+ EQ'W*'(*)IQeW}' 

where we employ the following fact that VA; £ {1, 2, K^: 

m,m+l Mm— l,m 

m=0 

= E Mm.m + l(i)(t^m(i) " Ut+l{t)) - fJ--l,o{t)Uo{t). 
m=0 

Note that the second and third terms of the RHS of H27|) 
are minimized by the PU congestion controller (|21|) and the 
hop/link scheduler (|22p . respectively, over a set of feasible 
algorithms including the stationary randomized algorithm 



SE introduced in Lemma 2. Then, we substitute into the 
second term of the RHS of (|27p a stationary randomized SE 
with admitted PU arrival rate vector {\l^Jke{i,2,...,K} and 
into the third terms the SE with admitted PU arrival rate 
vector (A^ 5 + t)k£{i,2,...,K}- After the above substitutions, 
we obtain: 

if 

AE-l/2E{^M-l.oWIQi5W} 
is = l 

if if 
<B2 - V2^A:,, -e^Q,(t)^Pfcl{3„,: „™=o (28) 



fc=i 
if 



les fc=i 



<B2-V2E^^.^-'^2EQ'W- 



We take the expectation of both sides of (|28|) over QeO-) 
and take the time average on f = 0, 1, T — 1, which leads 
to 



Si 



t=o les 



(29) 



<B2 + yY. ^{E (i)} - ^2 E 



t=0 fc = l 



By taking limsup of T on both sides of (|29|) , we can prove 
(I24|l . By taking the liminf of T on both sides of (|29|l , we can 
prove (|25p . Therefore, Theorem 2 is proved. 

5. ARBITRARY ARRIVAL RATES AT TRANS- 
PORT LAYER 

In the previous model description and algorithm develop- 
ment, we assumed that PU and SU packets are backlogged 
at the transport layer. In this section, we present optimal 
algorithms for the inelastic and elastic PU models, respec- 
tively, for arbitrary arrival rates at the transport layer. 

At the transport layer, let Ep{t) and Ei{t), I £ S, be 
the PU and SU arrival rates at the beginning of time slot 
t, respectively. We assume that Ep{t) and Ei{t) e <S 
are i.i.d. with respect to time. For simplicity of analysis, 
we assume that the time average arrival rate vector, formed 
by the PU and SU arrival rates, is in the exterior of the 
capacity region, so that a congestion controller is needed. 
Let Wp{t) and Wi{t), I £ S, he the backlog of PU and SU 
data at the transport layer. PU and SU buffer sizes at the 
transport layer are denoted by Wp and Ws, respectively. In 
the following subsections, we present modified algorithms 
that can handle arbitrary arrival rates at transport layer for 
inelastic and elastic PU models. 

5.1 Inelastic Algorithm for Arbitrary Arrival 
Rates at Transport Layer 

In the inelastic PU model, recalling that Ai(t) is the ad- 
mitted SU rate, we update the SU backlog Wi{t) at the 
transport layer as follows: 

Wi{t+1) = mm{[Wi{t)+Ei{t)~Ai{t)]+ ,Ws}, V/ £ 5. (30) 

Note that Wi{t) = V/ £ 5 and = if there is no 
buffer at SU transport layer. Similarly, we update the PU 
backlog Wp{t) at the transport layer as follows: 

Wpit +1)= mm{[Wpit) + Ep{t) - iXps^ (t)] + , Wp}. (31) 



Note that Wp{t) = Vt and Wp = when there is no buffer 
at PU transport layer. 

Following the idea introduced in [T^], we construct a vir- 
tual queue Yp{t) at the PU transport layer with queueing 
dynamics: 

Yp{t+1) = [Yp{t)~R{t)]+ + up{t), 

where Up{t) is an auxiliary variable associated with Yp{t). 
Similarly, we construct a virtual queue Yi{t), Z G 5, at the 
SU transport layer with queueing dynamics: 

Yi{t + l) = [Y{t)-Mt)]+ +ui{t), 

where ui{t) is an auxiliary variable associated with Yi{t), 
with ui being its time-average. Note that when Yi{t) is sta- 
ble, the time-average of SU admitted rate Ai{t) is greater 
than or equal to ui. Thus, when Yi{t) is stable, V/ £ 5, 
if we can ensure that X^jg^ <7i(^ii) is arbitrarily close to the 
optimal value X^igs fl! ('";*)> so is the SU utility. 

Instead of ((8|, the queue state Z{t) is now updated as: 

Zit + 1) = [Zit) - up{t)]+ + /-'(ap). 

Denote the time-average of Up{t) as Up. Thus, when Yp{t), 
Up{t) and Z{t) are stable, we have /(^i) > f{r) > f{up) > 
ap, where we recall that /i and r are the time-average val- 
ues of Hps pit) and R{t), respectively. Specifically, when 
Yp{t), Up{t) and Z{t) are stable, the PU minimum utility 
constraint is met. 

Now we provide the inelastic algorithm for arbitrary ar- 
rival rates at the transport layer: 

1) SU Congestion Controller: 
ui{t) and Ai{t), I £ S, are updated as follows: 



the following inequality on queue backlogs: 



min ui{t)Yi{t) -Vgi{ui{t)) 

0<uUt)<AM 



min Mt){Qi{t)-Yi{t)) 
i.t. < Mt) < mm{Wi{t) + Ei{t),AM} 



(32) 



(33) 



Note that p2p and (|33p can be solved independently and 
locally at every SU. 
2) R{t) Regulator: 



niin Up{t){Yp{t) ~ Z{t)) 

0<Up(t)<MM 



(34) 



mmR{t){ '^'' ^'■' Up(t)-Ypit)) 

QM (35) 

s.t. < R{t) < mm{Wp(t) + Ep(t), hm} 



Note that p4|) and (|35|) can be solved independently and 
locally at the source PU. 

3) PU Congestion Controller: 

max fipspit) (qui - /J-M - Usp{t)) 
s.t. < /ipspit) < mm{Wp{t) + E(^p),fiM} 

4) Link Rate Scheduler: The link scheduler is the same 
as dTU in Section 3.2. 

It is not difficult to check that Proposition 1 still holds, 
and we present the following theorem for the performance 
of the algorithm: 

Theorem 3. Let e > be chosen arbitrarily small. Given 
that qM > '^'^^^^^ -\- pjv/, the inelastic algorithm ensures 



hmsup i Y. + ^'W) + W + ^J'W + 

^ t=o ies 

53 + ViQM 



< 



where 3^= Bi+ NAff + fi\,j and Si is a constant. Further- 
more, the algorithm achieves: 



where we recall that (a;)igs is defined in Theorem 1. 

The proof follows similar steps as the proof of Theorem 
1. Due to space limitations, we omit the proof for Theorem 
3 and the choice of S3. Similar statements as presented in 
Remarks 1-4 also hold for the inelastic algorithm introduced 
in this subsection. 

5.2 Elastic Algorithm for Arbitrary Arrival Rates 
at Transport Layer 

In this subsection, the elastic algorithm for arbitrary ar- 
rival rates at transport layer and its performance are dis- 
cussed. Similar to inelastic algorithm, we denote by Ai{t) 
the admitted SU rate, which is upper-bounded by Am- We 
update the SU backlogs Wi{t) at the transport layer as H30p . 
Similarly, we can update the PU backlog Wp{t) at the trans- 
port layer as: 

K 

Wp{t + 1) = mm{[Wp(t) + Ep{t) - M-i.o(i)] + , Wp}. 

fe=i 

Similar to the previous subsection, we construct virtual 
queues Yp(t) and Yi{t), V/ £ 5, with an auxiliary variable 
Up{t) associated with Yp{t). The virtual queues evolve as 
follows: 



Yp{t + 1) = [Yp{t) - i,o(t)]+ + Mt); 
fc=i 

Yi{t + 1) = [Yi(t) - Aiit)] + 



3m: vV^—l}'} 



V/ e s. 



Note that when Yp{t) is stable, if we can ensure that Up is 
arbitrarily close to the optimal value X^t^i -^fci then so is the 
PU throughput, where we recall that Up is the time average 
of Up(t). In addition, when Yi{t) is stable, £ 5, the SUs' 
throughput is proportional to the PU data that they relay. 

Now we provide the elastic algorithm for arbitrary arrival 
rates at the transport layer: 

1) SU Congestion Controller: 



min Ai(t)(Qi{t)-Yi(t)),\JleS. 

0< A, (t)<min{W, (O + S; (t),^M } 

Note that the SU congestion controller can be solved locally 
at each SU. 

2) PU Congestion Controller: 



min Up{t){Yp{t) -V2) 



(36) 



{3m: uJT^ — 

+ US{t)-Y,{t)) 

K 

s.t. < ^^t^i,o(t) < min{Wp(t) + mm}. 



(37) 



Note that p6p and (|37|l can be solved independently. 

3) Link/Hop Rate Scheduler: The link/hop scheduler 
is the same as (|22p in Section 4.1. 

We present Proposition 3 and Theorem 4 to characterize 
the performance of the proposed algorithm: 

Proposition 3. Vm e {0, 1, J/fc}, Vfc e {1, 2, Tt"}, 
f/ie following inequality holds: 

Ut(t) <2llM + V2. 

Theorem 4. Let e > be chosen arbitrarily small. The 
algorithm ensures the following inequality on queue backlogs: 



1 

limsup - J2 K{E(Q' w + w) + ^r>m < 



Bi + V2BR 



where Bi = B2 + /ii/ + NA\,i and 64 > is a constant. 
Furthermore, the inelastic algorithm achieves: 



T-l K K 



Bi 
V2 ' 



The proofs of Proposition 3 and Theorem 4 follow similar 
steps as the proofs of Proposition 2 and Theorem 2, respec- 
tively. Detailed proofs and the choice of 84, are omitted due 
to limited space. Remarks 6-8 hold for the elastic algorithm 
introduced in this subsection with minor modifications. 

6. CONCLUSIONS AND FUTURE WORKS 

In this paper, two cross-layer scheduling algorithms for 
multi-hop cooperative cognitive radio networks are intro- 
duced. The algorithms can achieve arbitrarily close to the 
optimal throughput/utility, with a tradeoff in the determin- 
istically upper-bounded PU buffer sizes and hence the av- 
erage end-to-end delay upper-bounds. Our work aims at a 
better understanding of the fundamental properties and per- 
formance limits of QoS-constrained multi-hop CRNs. In our 
future work, we will investigate distributed implementations 
and power management in CRNs. 
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